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It is an important topic to investigate nature of the phase transition in wide 
area of science such as statistical physics, materials science, and computational 
science. Recently it has been reported the efficiency of quantum adiabatic evo- 
lution / quantum annealing for systems which exhibit a phase transition, and we 
cannot obtain a good solution in such systems. Thus, to control the nature of 
the phase transition has been also attracted attention in quantum information 
science. In this paper we review nature of the phase transition and how to con- 
trol the order of the phase transition. We take the Ising model, the standard 
Potts model, the Blume-Capel model, the Wajnflasz-Pick model, and the Potts 
model with invisible states for instance. Until now there is no general method 
to avoid the difficulty of annealing method in systems which exhibit a phase 
transition. It is a challenging problem to propose a method how to erase or 
how to control the nature of the phase transition in the target system. 

Keywords: Phase transition; Potts model with invisible states; Entropy effect; 
Quantum annealing 



1. Introduction 

To study nature of the phase transition has been attracted attention in 
wide area of science such as materials science and statistical physics. If 
we change control parameters such as temperature, pressure, and exter- 
nal field, we can observe phase transition in many materials. In respective 
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materials, a macroscopic ordered state (e.g. ferromagnetism, fcrroelectoric- 
ity, superfluidity, and superconductivity) appears, which is characterized 
by each corresponding order parameter. The Ising model was proposed in 
1925, which is regarded as the most fundamental magnetic model to study 
the nature of the phase transition from a microscopic viewpoint in statis- 
tical physics.^ It is not too much to say that the Ising model triggers the 
development of statistical physics. Since the Ising model can be easily gen- 
eralized because of simplicity, a number of generalized models have been 
proposed up to the present. The relation between the universality class and 
the symmetry which breaks at the transition point has been studied by 
analysis of these models. In general, the Hamiltonian of the Ising model 
with site-dependent external magnetic held hi is expressed by 



where cr| is a microscopic variable at the z-th site. Hereafter the g-i&ctor 
and the Bohr magneton arc set to be miity for simplicity. When > 0, 
the interaction between the i-th and j-th sites is ferromagnetic, whereas for 
Jij < 0, the interaction is antiferromagnetic. We can adopt the Ising model 
for not only analysis of phase transition observed in real materials but 
also information science/technology. In information science/technology, a 
binary representation is a basic language. Then, an interdisciplinary science 
which is the interface between statistical physics and information science 
has been developed in terms of the Ising model. Actually some difficulties of 
information science/engineering were solved from a viewpoint of statistical 
physics.^ 

Optimization problem is a problem to find the minimum/maximum 
value of real- valued cost/gain function. Then, to solve an optimization prob- 
lem corresponds to find the equilibrium state at finite temperature or the 
ground state of the Hamiltonian which expresses the target optimization 
problem. In many cases we can represent optimization problem by the Ising 
model or its generalized model. An algorithm which can solve optimization 
problem in a general way was proposed by Kirkpatrick. This method is 
called simulated annealing. ^'^ In general, energy landscape of optimization 
problems is complicated as random spin systcinis.''^^ In the simulatcid an- 
nealing, we gradually decrease temperature and can obtain a not so bad or 
the best solution. A characteristic transition time at the temperature T is 
expressed r oc e^^^, where 13 denotes the inverse temperature = T~^) 
and AE represents a characteristic energy difference. For simplicity, the 
Boltzmann constant A;b is set to be unity. Since the probability distribution 
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of equilibrium state is almost fiat at high temperature, r becomes short. It 
was shown that by decreasing temperature slow enough, we can obtain the 
best solution of optimization problems by Geman and Geman.^ Since the 
simulated annealing is easy to implement, this is adopted in many cases. ^ 

The simulated annealing finds a not so bad solution or the best solu- 
tion by making use of thermal fluctuation. In 1998, on the contrary, Kad- 
owaki and Nishimori proposed an alternative method of simulated anneal- 
ing, which is called quantum annealing. '^'^ In the quantum annealing, we 
decrease the quantum field {i.e. quantum fluctuation) instead of temper- 
ature in the simulated annealing. By using the quantum annealing, 
we can succeed to obtain a better solution than the solution obtained by 
the simulated annealing in many cases. ^^^^^ Thus, the quantum annealing 
is expected as a powerful tool for optimization problems. ■^'^^'^^ In order to 
improve this method more efficient, the quantum annealing from a view- 
point of statistical physics has been studied. Annealing methods which are 
based on statistical physics seem to work well in all optimization problems 
since these methods are easily performed. However there is a weak point 
in both simulated annealing and quantum annealing. When we decrease 
temperature/quantum field across a phase transition point, we obtain not 
so good solution in general. Especially, if a first-order phase transition 
occurs during annealing, we can not obtain the best solution definitely.^^ 
The situation is improved if a second-order phase transition takes place but 
some kind of critical slowing down exists. Thus, it is an important issue 
to investigate how to erase the phase transition or how to change the order 
of the phase transition from first-order to second-order. 

In this paper we focus on how to control the order of the phase tran- 
sition. The organization of the rest of the paper is as follows. In Section 
2, we explain nature of the phase transition taking as examples some fun- 
damental models. In Section 3, we review how to change the order of the 
phase transition for preceding studies. We take the Blumc-Capcl model and 
the Wajnflasz-Pick model for instance. In Section 4, we consider the Potts 
model with invisible states. In Section 5, we summarize this paper and show 
future perspective. 

2. Nature of the Phase Transition 

Phase transition can be categorized into two types according to singularity 
of the free energy as a function of control parameter in the thermodynamic 
limit. If there is a singularity in differential coefficient of first order of free 
energy, a first-order phase transition occurs and then, energy and order pa- 
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rameter jump at the transition point. From this feature, a first-order phase 
transition is called discontinuous phase transition. On the other hand, if 
there is a singularity in differential coefficient of second order of free energy, 
a second-order phase transition takes place. In this case, energy and order 
parameter arc continuous even at the transition point. Then, a second-order 
phase transition is called continuous phase transition as against discontinu- 
ous phase transition. When a second-order phase transition occurs, physical 
quantities near the transition point should be represented by power func- 
tions. The exponents of these functions are called critical exponents. A set 
of values of critical exponents corresponds to a universality class. Univer- 
sality class has been investigated exhaustively by analytical methods and 
numerical methods such as Monte Carlo simulation. We can categorize a 
phase transition according to ^^encyclopedia of universality class" ^. 

Here we explain the phase transition of the ferromagnetic Ising model 
with nearest-neighbor interaction under homogeneous external magnetic 
field. The Hamiltonian is given as 



Hereafter denotes the nearest neighbor spin pair on the defined d- 

dimensional lattice, and we take J as the energy unit throughout this paper. 
The phase diagram of this model for > 2 is depicted in Fig. 1 (a)^. The 
horizontal and vertical axes in this figure are temperature T and external 
magnetic field h, respectively. The bold line and the circle in Fig. 1 (a) 
are the ferromagnetic phase and the critical point Tc. When we decrease 
temperature under zero field (see the line (i) in Fig. 1 (a)), a second-order 
phase transition with spontaneous twofold symmetry breaking occurs at 
the critical point Tc. In this model, the order parameter is magnetization 
defined as 



where N is the number of spins. When the external magnetic field is zero, 
the behavior of magnetization is shown in Fig. 1 (b). On the other hand, 
when we change the external magnetic field with fixed temperature below 
Tc (see the line (ii) in Fig. 1 (a)), a first-order phase transition occurs and 




(3) 



''In some cases, novel universality class is found. It should be noted that to explore new 
universality class itself is an important topic in statistical physics. 
''On the one-dimensional lattice, there is no phase transition. 
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Fig. 1. (a) Phase diagram of the ferromagnetic Ising model for d > 2. The bold line 
represents ferromagnetic phase, and the circle denotes the critical point Tc. (b) Behav- 
ior of magnetization when we decrease temperature at /i = as the line (i) in (a). In 
actual, either the upper or lower branch is selected. This phenomenon is called sponta- 
neous symmetry breaking. A second-order phase transition occurs at Tc. (c) Behavior 
of magnetization when we change external magnetic field at T < Tc as the line (ii) in 
(a). A first-order phase transition occurs, (d) Behavior of magnetization when we change 
external magnetic field at T > Tc as the line (iii) in (a). No phase transition happens. 

the magnetization jumps at /i = as depicted in Fig. 1 (c). When we change 
the external magnetic field with fixed temperature above Tc (see the line 
(iii) in Fig. 1 (a)), the magnetization behaves as a smooth function shown 
in Fig. 1 (d). When we sweep external magnetic field along the line (ii) 
in Fig. 1 (a) at finite speed, hysteresis curve is often observed because of 
existence of the metastable state. 

Suppose we perform simulated/quantum annealing for systems which 
exhibit a first-order phase transition. When we decrease tempera- 
ture/quantum field across the transition point, the state is trapped in the 
metastable states. Then we cannot obtain not so bad solution by annealing 
methods. Next we consider the case for second-order phase transition. Phys- 
ical quantities converge to the equilibrium value slowly because of some kind 
of critical slowing down. This nature was studied recently, which is called 
the Kibble-Zurek mechanism. ■^'^"^^ 

The relation between the order of the phase transition and the symmetry 
which breaks at the transition point has been considered by using the stan- 
dard ferromagnetic Potts model. The Hamiltonian of the ferromagnetic 
g-state Potts model is given as 




(4) 



Since the 2-state Potts model is equivalent to the Ising model, the g-state 
Potts model is regarded as a straightforward extension of the Ising model. 
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Table 1. Relation between the order of the phase transition and q in the 
standard ferromagnetic Potts model on d-dimensional lattice. Note that g-fold 
symmetry breaJfs at the transition point. 



Dimension d 


Second-order phase transition 


First-order phase transition 


1 


x« 




2 


q < 4 


q> 4 


d>3 


q = l,2^ 


q>3^ 



Note: * On one-dimensional lattice, phase transition does not occur. ^ There 
is no ex3x:t result of boundary value of q between second-order phase tran- 
sition and first-order phase transition. It is true that g-state Potts model on 
d-dimensional {d > 3) lattice for g = 1, 2 exhibits a second-order phase transi- 
tion whereas a first-order phase transition takes place in that model for q > 3. 

The Potts model is used for analysis of coloring problems and clustering 
problems/^'^" and plays an important role for not only statistical physics 
but also information science. In this model on one-dimensional lattice, there 
is no phase transition at finite temperature for arbitrary q as well as the 
Ising model. 

It is convenient to introduce another representation of Kronecker's delta 

as 

= ' + (5) 

where (/i = 1, ■ • • , (7) represents q unit vectors pointing in the q symmet- 
ric direction of a hyper-tetrahedron in g — 1 dimensions.'*" Then the order 
parameter of this model can be defined as 



mpotts ^ 

This model on two-dimensional lattice exhibits a second-order phase tran- 
sition with g-fold symmetry breaking for < 4 whereas a first-order phase 

transition with (7-fold symmetry breaking for g > 4. In a similar way, the 
relation between the order of the phase transition and the symmetry which 
breaks at the transition point for > 2 is also investigated as shown in 
Table 1.*^ 



3. Preceding Models 

In this section wc review two famous preceding models. Both of two models 
are some kind of generalized Ising model. 
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3.1. Blume-Capel Model 

We explain nature of the phase transition of the Blume-Capel model. ''^'^^ 
The Hamiltonian of this model is given as 

nBG = -JY.^^tJ-DY,tl iJ>o), ^^ = +1,0,-1. (7) 

Here we refer to = as vacancy. At D = — oo, vacancy is suppressed and 
the state of each spin is U = +1 or —1, whereas at D = +oo, all spins be- 
come vacancies. This model can represent magnetic lattice gas or annealed 
diluted Ising model, where D corresponds to the chemical potential. This 
model has been widely used analysis of multicritical phenomena in metallic 
alloys and liquid crystals etc.'^^^^'^ 

Schematic phase diagram of the Blume-Capel model is depicted in 
Fig. 2. The solid and dotted curves are second-order phase transition and 
first-order phase transition, respectively. The circle between the solid and 
dotted curves in Fig. 2 represents the tricritical point (Tc, Dc). Thus the 
Blume-Capel model is a fundamental model which has a tricritical point. In 
this model we can change the order of the phase transition by controlling the 
chemical potential D. When we decrease temperature for fixed D{< Dc), a 
second-order phase transition occurs, whereas a first-order phase transition 
takes place when we decrease temperature for fixed D{> Dc). It should be 
noted that the ground state is also changed when we control D. Then this 
type of control method for changing the order of the phase transition is not 
suitable for annealing methods. 




Fig. 2. Schematic phase diagram of the Blume-Capel model. The solid and dotted 
curves represent second-order phase transition and first-order phase transition, respec- 
tively. The circle indicates the tricritical point {Tc,Dc). 
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3.2. Wajnflasz-Pick Model 

Next we review nature of the phase transition of the Wajnflasz-Pick 
modeL^* The Hamiltonian of the Wajnflasz-Pick model is given as 

Hwp = --^ SjSj - /t Sj, Sj = +1, ■ ■ ■ , +1 , -1, • ■ • , -1 , (8) 

where g+ and g- are the number of +l-state and that of — 1-state, re- 
spectively, and we assume J > 0. Note that this model for g+ = g- = 1 
corresponds to the standard Ising model. We can transform this Hamilto- 
nian into the following Hamiltonian at finite temperature T: 

^Wp = -^E^M-(/^-|iogf7)E^i' ^■=+1,-1- (9) 

Note that the number of -|-l-state and that of —1-state are unity. These two 
Hamiltonians are equivalent since the partition functions of these Hamil- 
tonians are the same, i.e. Tre"'^^™^ = Tre~'^'^wp. The second term of 
Eq. (9) consists of the original external magnetic field h and temperature- 
dependent part. The latter comes from the entropy effect of the bias of g+ 
and g_. When g^ = g_, this term disappears, and the Hamiltonian given by 
Eq. (9) becomes the standard Ising model. From this fact, the temperature- 
dependent external magnetic field can be regarded as the entropy-induced 
internal field. The Wajnflasz-Pick model has been adopted for analysis of 
phase transition in spin-crossover materials. ^''"^"^ 

We can analyze phase transition in this model by using the phase dia- 
gram of the standard Ising model. Here, the coefficient of second term in 
Eq. (9) is represented as 

/i':=/i-|log^. (10) 

Then the Hamiltonian given by Eq. (9) becomes the standard Ising model 
with external magnetic field h' , and the h' — T phase diagram of this model 
is shown in Fig. 3. We consider the case for fixed finite external magnetic 
field h = Hq. If we change the ratio g^/g^, we can control the order of 
the phase transition as depicted in Fig. 3. In this model, to change tem- 
perature corresponds to the tilted lines in Fig. 3, and a slope of trajec- 
tory changes by the ratio g+/g- according to Eq. (10). If we set the ratio 
g+/g- = exp(2/io/T'c) =: g*, where is the critical point of the standard 
Ising model, a second-order phase transition occurs when we decrease tem- 
perature. If the ratio g+/g- is smaller than g* , no phase transition occurs, 
whereas a first-order phase transition takes place when g+/g- is larger 
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Fig. 3. The bold line and the circle represent ferromagnetic phase and the critical point 
Tc of the Ising model. The thin lines correspond to changing the temperature at fixed 
external magnetic field /iq- The gradients of these lines are equal to log(g+/g_)/2. 

than g* . Thus, the Wajnflasz-Pick model is a standard model where we can 
change the order of the phase transition without changing the ground state 
by just controlling the ratio g+/g-. It should be noted that the all phase 
transitions in this model do not accompany the twofold symmetry breaking 
which is the characteristic property of the standard Ising model, except for 
/lo = and g-\- = g- (i.e. the standard ferromagnetic Ising model without 
external field). 

4. Potts Model with Invisible States 

In Section 2, we reviewed nature of the phase transition in the standard 
ferromagnetic Potts model. It has been considered that the relation be- 
tween the order of the phase transition and the symmetry which breaks at 
the transition point was investigated completely. The standard ferromag- 
netic Potts model has actually succeeded to analyze a phase transition with 
discrete symmetry breaking appeared in real materials and complicated the- 
oretical models. Very recently, however, some phase transitions which are 
not consistent with the nature of the phase transition in the standard Potts 
model were reported, although these phase transitions accompany discrete 
symmetry breaking. ^''^^^ For instance, a first-order phase transition with 
threefold symmetry breaking occurs on two-dimensional lattice. According 
to Table 1, the 3-state ferromagnetic Potts model on two-dimensional lat- 
tice should exhibit a second-order phase transition with threefold symme- 
try breaking. This behavior is controversial feature. In order to understand 
what happens in such phase transitions, we should propose a new model. 

As we mentioned in Section 3, we can control the order of the phase 
transition by changing the chemical potential of vacancy or changing the 
bias of the number of states. Roughly speaking, the Blume-Capel model 
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and the Wajnflasz-Pick model change the internal energy and the entropy, 
respectively. Motivated by these models, we constructed a new model - 
Potts model with invisible states^®"^° to explain the nature of the above 
mentioned intriguing phase transition. The Hamiltonian of this model is 
given as 



■Hpi = -J^(5t,,t^. ^(5t.,a, t, = 1,- ■ ■ ,q,q + l,- ■ ■ ,q + r, (11) 



where the states I < ti < q and q+l<ti<q + r are referred to as colored 
states and invisible states, respectively, and we assume J > 0. Hereafter 
we refer to this model as {q,r)-sta.tc Potts model. Obviously, this model for 
r = corresponds to the standard Potts model, and then, this model is 
regarded as the straight forward extension of the standard Potts model. 

First, we consider two spin case for simplicity i.e. Hpi = 
— JSti.t2 Sq=i ^ti,a- When I < ti — t2 < q, the energy becomes — J, oth- 
erwise the energy becomes zero. Notice that even when ti = t2, the energy 
becomes zero if(?-t-l<ti=i2<'? + f, which differs from the case of the 
standard ferromagnetic Potts model. The energy structure of this model 
is depicted in Fig. 4. The number of ground states is q and the number 
of excited states is [q + r)^ — whereas the number of excited states is 
(7^ — g for r = (standard Potts model) . Only the number of excited states 
increases by adding the invisible states into the standard Potts model. It 
should be noted that the number of ground states of the model given by 
Eq. (11) and that of the standard Potts model are the same. 

At finite temperature T, we can transform this Hamiltonian into the 



(a) (b) 

(£/"-(/)-state (((/+r)--(/)-state 



[/-state ^-state 

Fig. 4. (a) Energy structure of g-state Potts model for N = 2. The number of ground 
states and that of excited states are q and — q, respectively, (b) Energy structure of 
(g,r)-state Potts model for N = 2. The number of ground states and that of excited 
states are q and (q + r)^ — q, respectively. 
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following form as well as the Wajnflasz-Pick model: 

n'p, = -jJ2^s,,s,^S,,^„-T\ogrJ2Kfi, Si = 0,1,- ■■ ,q. (12) 

ihj) «=i » 

Here we rename the label of invisible states from q + I < U < q + r 
to Si = 0. The partition functions of both Hamiltonians are the same: 
'P]-g-/3'Hpi _ Tre~^^pi. The second term of this Hamiltonian is regarded as 
the chemical potential of invisible states and comes from the entropy effect 
of the number of invisible states r. 

4.1. Mean-Field Analysis 

We study phase transition in the (g,r)-state Potts model by the Bragg- 
Williams approximation as well as the standard ferromagnetic g'-state Potts 
model. ^"'^ Since the number of ground states of this model is q, if a phase 
transition takes place, g-fold symmetry breaks at the transition point Tc- 
Let Wa be the fraction of the a-th state (0 < a < g). Here we use the 
notation of the Hamiltonian given by Eq. (12) and then the label of the 
invisible state is zero. We assume that the first state is selected below 
the transition point after g-fold symmetry breaks. Then {wa} can be 
represented as 

{wo = y 
w^ = l{l-y)[l + {q-l)x] , (13) 

= ^{1 - y){l - x) {2<a<q) 

where < x,y < I. The fraction of the invisible states is represented 
by y, and x indicates the degree of ordering. When a; = 0, the system is 
paramagnetic state, whereas when a; = 1, the system is completely ordered 
state. It is a natural condition that Wa's for 2 < a < q are the same. 
The internal energy and the entropy in the level of the Bragg- Williams 
approximation are given by 

E^'^{x,y) = -woTlogr -^j^^' (1^) 
S'''^ix,y) = -^w^logw^, (15) 

a=0 
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(b) 



Fig. 5. (a) Transition temperature as a function of the number of invisible states r for 
z = 4. (b) Latent heat as a function of r for z = 4. Both results are obtained by the 
Bragg- Williams approximation. 



respectively. The parameter z in Eq. (14) is the number of the nearest- 
neighbor sites. As a result, the free energy can be written as 

F^'^{x,y)^E^'^{x,y)-TS^'^{x,y) 



2^ -[(g-l)a;^ + l]+yTlog-^ 



l + log l + ^ {l-y){l-x) 

q 1— X a 



.(16) 



From this free energy, the transition temperature and the latent heat can 
be obtained by numerical calculation. The number of invisible states r de- 
pendencies of the transition temperature and the latent heat for g' = 2, 3, 
and 4 are shown in Fig. 5. 

The latent heat expresses the energy difference between metastable state 
and stable state at the transition temperature. By the definition, if the 
latent heat is a finite value, the internal energy jumps at the transition 
temperature. Thus a finite latent heat indicates that a first-order phase 
transition occurs. From Fig. 5 (b), the (2,r)-state Potts model for r < 3 
exhibits a second-order phase transition and others have a first-order phase 
transition. As the number of invisible states r increases, the transition tem- 
perature decreases and the latent heat increases. This result is quite natural 
since the invisible states contribute to the entropy. To clarify the effect of 
the invisible states, we compare with the transition temperature and the 
latent heat for r = (standard Potts model). The transition temperature 
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Fig. 6. Phase diagram of the Blume-Emery-Griffiths model for ,/ = ,/' obtained by the 
Bragg- Williams approximation for z = 4. The thick solid and dotted curves indicate 
second-order phase transition and first-order phase transition. The thin lines correspond 
to decreasing temperature for r = 2, 3, 4, 10, and 100 from bottom to top. The gradients 
of these lines are log r. 



and the latent heat for r = arc obtained as 
jTBW(^ = 2,r = 0) = # 

BW/ 



|tBW(,> 3,.. 0)^,^(15!) 
\A£;BW(g>3,r = 0) = ^ 



-2f 
2g(g-l) 



(17) 
(18) 



The transition temperature and the latent heat for r = and z = 4 are 
also shown in Fig. 5. 

We also consider the relation between the (2,r)-state Potts model and 
the Blume-Emery-GrifBths model^'^ which is an extended model of the 
Blume-Capel model. The Hamiltonian of the Blume-Emery-Griffiths model 
is given by 

^BEG = E - y E ^^^^3 - ^ - *i )' = +1' 0' 

where the biquadratic interaction (the second term) is introduced into the 
Blume-Capel model. The Blume-Emery-Griffiths model for J = J' and D = 

Tlogr is equivalent to the (2,r)-state Potts model. In order to investigate 
nature of the phase transition of this model, we obtain the phase diagram of 
the model for J = J' and unfixed D by the Bragg- Williams approximation 
for z = 4. 

The phase diagram of the Bhime-Emery-Grifhths model for J = J' 
is depicted in Fig. 6. The thick solid and dotted curves indicate second- 
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order phase transition and first-order phase transition, respectively. Here 
we consider the case for D = Tlogr. To change temperature corresponds 
to the thin hnes in Fig. 6. The gradients of these hnes are logr. When we 
decrease temperature for the case of r = 2 and 3, the lines cross a second- 
order phase transition curve whereas the lines for large r cross a first-order 
phase transition curve. This result is consistent with the result shown in 
Fig. 5. 

4.2. Monte Carlo Simulation 

In the previous subsection we studied the order of the phase transition 

and the latent heat in the {q,r)-state Potts model by the Bragg- Williams 
approximation. These results correspond to the infinite-dimensional version 
of the ((7,r)-state Potts model. Then in order to consider nature of the phase 
transition in the (g,r)-state Potts model on finite-dimensional lattice, we 
study thermodynamic properties of this model on the L x L{= N) square 
lattice by Monte Carlo simulation. 

First we calculate temperature dependencies of the order parameter 
iTiPous, the density of invisible states pi^v, the internal energy E, and the 
specific heat C for (g,r)=(4,20). The definition of pinv is defined by 



It should be noted that we use the order parameter of the standard ferro- 
magnetic g-state Potts model given by Eq. (6). These quantities as functions 
of temperature are shown in Fig. 7. Figure 7 (a) shows temperature depen- 
dency of the order parameter |mpottsP, which indicates fourfold symmetry 
breaks at the transition temperature. The fraction of the invisible states 
as a function of temperature is shown in Fig. 7 (b). As the temperature 
increases, the fraction of invisible states increases. At T = oo, this value 
becomes r/ (q + r) = 0.833 • • • by the definition whereas this value becomes 
zero at T = 0. Figure 7 (c) and (d) display the internal energy and the 
specific heat, respectively. The specific heat is not divergent behavior but 
has a finite large value at the transition temperature. This result indicates 
that a first-order phase transition takes place. 

In order to confirm that this phase transition is of first-order, we cal- 
culate energy histogram at the temperature Tc(L) where the specific heat 
has the maximum value. The temperature Tc{L) is obtained by reweighting 




q+r 



(20) 
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Fig. 7. Temperature dependencies of (a) the order parameter, (b) the fraction of the 
invisible states, (c) the internal energy, and (d) the specific heat for the (4,20)-state Potts 
model. The error bars are omitted for clarity since they are smaller than the symbol size. 



method. ^^'^^ The energy histogram P{E) is defined as 

PiE) = W{E)e-^^, (21) 

where W{E) is the number of states in energy E. Figure 8 shows the en- 
ergy histogram at Tc{L) for L — 32, 64, and 96. A bimodal distribution 
is observed, which is a characteristic behavior of system which exhibits a 
first-order phase transition. As the number of spins increases, the two peaks 
become sharp. In the thermodynamic hmit, these two peaks are expected 
to be the delta functions. 

Next we take finite-size scahng in order to dcitermine the transition 
temperature and the latent heat in the thermodynamic limit. We adopt the 
following functions:^* 

T,{L)^aL-'' + T„ (22) 

(23) 
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Fig. 9. (a) The temperature Tc(L) as a function of for the {4,20)-state Potts modeh 
The dotted hne is a fitting line given by Eq. (22) . The intercept of the fitting line indicates 
the transition point Tc. (b) The maximum value of the specific heat as a function of 
for the (4,20)-state Potts model. The dotted line is a fitting line given by Eq. (23). 



where C„iax(-^) and are the maximum value of the specific heat for 
L X L system and the latent heat in the thermodynamic limit, respectively. 
In this case, wc adopt d = 2. Figure 9 (a) shows Tc{L) as a function of L~^. 
The intercept of the dotted line corresponds to the transition temperature 
Tc- The maximum value of the specific heat Cinax(.^) as a function of 
is depicted in Fig. 9 (b). From these results, the transition temperature 
and the latent heat are obtained as = 0.61683(1) and AE = 0.68(2), 
respectively. This fact indicates that we succeeded to construct model which 
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Table 2. The transition temperature and the latent 
heat for several {q,r) on the square lattice. 



('?.'•) 


Latent heat 


Transition temperature 


(2,0)'' 





1.13459 


(2,30)'' 


1.02(2) 


0.57837(1) 


(2,32)== 


1.23(2) 


0.56857(1) 


(3,0)'' 





0.994973 


(3,25)b 


0.81(2) 


0.59630(1) 


(3,27)'^ 


1.05(2) 


0.58513(1) 


(4,0)=^ 





0.910239 


(4,20)'' 


0.68(2) 


0.61683(1) 


(4,22)<= 


0.87(2) 


0.60396(1) 



Note: ^ These results were obtained exactly. ^ These 
results were first obtained in Ref. 58. These results 
were obtained in Ref. 59. 



exhibits a first-order phase transition with fourfold symmetry breaking on 
the two-dimensional lattice. By the same procedure, we can obtain the 
transition temperature and the latent heat for several (g,r) (see Table 2). 

As the number of invisible states increases, the transition temperature 
decreases and the latent heat increases, which is qualitatively consistent 
with the result obtained by the Bragg- Williams approximation. Thus, we 
conclude that invisible state in the Potts model stimulates a first-order 
phase transition. From this, unfortunately, this model is not useful for the 
optimization problems. Recently, nature of the phase transition in the {q,r)- 
state Potts model has been confirmed by a number of researchers.^^"®'' 

4.3. Another Representation of the Potts Model with 
Invisible States 

So far, we showed thermodynamic properties and phase transition of the 

{q,r)-sta.tc Potts model. This model is regarded as a straightforward exten- 
sion of the standard q'-state Potts model. In order to make it more clear, 
we show another representation of the Potts model with invisible states. 
First wc consider the standard g-state Potts model. Let Si be a state vec- 
tor at the i-th site. The state vector is (j-dimensional binary vector. Only 
one element in this vector is one and the others are zero. The position of 
one corresponds to the state. For example, when Si = -^(0, 0, 1, 0, ■ • • ,0), 
the state of the i-th site is the third state. Here '^v represents the transpose 
of the vector v. We can express the Hamiltonian by matrix representation 
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as follows: 

"^PottS = — J ^Si<^3 ~ " 5Z ^i'^PoiisSj, (24) 

(id) (iJ) 

where Jpotts is a q-hy-q diagonal matrix whose elements are expressed as 

^Potts = diag( J, , J ). (25) 

Next we consider such a representation of the (g,r)-state Potts model. Let 
Ti be a (g + r)-dimensional indicator vector. The Hamiltonian of the Potts 
model with invisible states is represented as 

Hpi = -jJ2 J2 ^TiJpiTj, (26) 

where Jpi is a (g + r)-hy-{q + r) diagonal matrix whose elements are ex- 
pressed as 

Jpi = diag( J^_^, 0^_^) . (27) 

q r 

We can construct more generalized model by using the matrix represen- 
tation by introducing the off-diagonal elements like the clock model, for 

instance. It is an important topic to control the order of the phase transi- 
tion by changing the form of the interaction matrix J. 



5. Conclusion and Future Perspective 

In this paper we reviewed nature of first-order and second-order phase tran- 
sitions in general by taking the Ising model for instance. Wc demonstrated 
how to change the order of the phase transition by using the Blume-Capel 
model and the Wajnflasz-Pick model. In the Blume-Capel model, we can 
change the order of the phase transition by changing the chemical poten- 
tial of vacancy. In this model, the ground state changes when we control 
the chemical potential. In the Wajnflasz-Pick model, on the other hand, 
by changing the bias of the number of states, the order of the phase tran- 
sition can be changed without changing the ground state. By introducing 
the effects in both models into the standard Potts model, we constructed a 
generalized Potts model - Potts model with invisible states. The invisible 
state corresponds to the vacancy as well as the Blume-Capel model and 
the number of the invisible states contributes to the entropy as well as the 
Wajnflasz-Pick model. We can control the order of the phase transition by 
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just changing the number of invisible states without variation of ground 
state. Then as the number of invisible states increases, the transition tem- 
perature decreases and the latent heat increases. 

To change the order of the phase transition is an important topic for 
not only statistical physics hut also computational science and quantum 
information theory (especially, quantum annealing or quantum adiabatic 
computation). Simulated annealing and quantum annealing which are based 
on (quantum) statistical physics do not work well in systems which exhibit 
a first-order phase transition. If a second-order phase transition takes place, 
a situation becomes not so bad, but a kind of critical slowing down problem 
remains. Phase transition in systems is obstacle in optimization problems 
whenever we use some kind of annealing procedures. Then it is anticipated 
to propose a method to control the order of the phase transition or to 
erase the phase transition if possible. Unfortunately, the invisible state in 
the Potts model stimulates a first-order phase transition and is not useful 
for annealing methods in the present stage. However our proposed method 
to generalize models is quite general and simple. Thus it is expected that 
how to erase the phase transition or how to change the order of the phase 
transition will be found in a similar way. 
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